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For: KALMAN TRACKING OF COLOR OBJECTS 

SCHEDULE OF AMENDMENTS 
Rewrite the paragraph beginning on page 5/ line 4, to read as 
follows: 

Kalman tracking applies a Newtonian motion model to the centroids 
of the objects of interest. As an example, the objective is to track 
object #K in Fig. 3, whose location in the starting frame Iq of the 
input video image sequence is identified by the user. Object #K 
belonge to color model #A while a different object #L belongs to color 
model #B. The user "clicks" on the estimated location of the centroid 
(geometric center) of the object #K and ther-eby identified the object 
#K as an object of interest . The Kalman state vector at time "n" is: 



[n] 

v^[n] 
[n] 



where (x^, y^) are the location coordinates of the centroid for object 
#K, and (vj,^5, Vy^) are the velocity components of object #K. The 
Newtonian motion model for all objects assumes that acceleration is a 
white-noise process- This motion model is well known in the art and 
may be found in the literature on Kalman filtering. 
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Rewrite the paragraph beginning on page 7, line 17, to read as 
follows : 

For the initialization of the process the position of the 
centroid in frame lo. IkMOlO], is determined. The user "clicks" near 
the visually estimated geometric center of the object #K, and that 
point serves as the initial position. The initial velocity is set to 
zero. Then [vales] values for R^', R^** and z:^[o|o] are determined 
experimentally and used to determine the centroid position. One such 
set is 

Sk^ - |2,0, 0; 0, B.OI; ^ |l, 0; 0, 2|; r^[0|0] ^ |l.6, 0, 0, 0; 0, 

3.2, 0, 0; 0, 0, 2.0, 0; 0. 0, 0, 4.0| 

Rewrite the paragraph beginning on page 8, line 9, to read as 
follows i 

Sometimes, due to the geometric shape of the object or due to 
sudden changes in acceleration, the Kalman prediction points to a 
centroid location that is outside the boundary of the object #K, as 
shown in Pig. 5, This situation arises when the PxQ block that 
contains the predicted centroid position is classified by the color 
segmentation algorithm as belonging to a class other than color model 
#A, Again this situation is easily detected. To recover from this, 
search around a local neighborhood of the predicted centroid position. 
As shown in Fig. 6, begin at the PxQ block that contains the predicted 
centroid position and examine PxQ blocks in a spiral search pattern 
until one is found that belongs to color model #A. Then grow a 
connected region around this block and label it as object #K in frame 
In^i- The radius of the spiral search is a parameter that may he 
adjusted for each input video image sequence. If the objects of 
interest move slowly and are "convex" in shape, [than] then a small 
search radius, such as a 5x5 neighborhood, is generally sufficient. 
If there is rapid and random motion, then a larger search range is 
desired. 

Rewrite the paragraph beginning on page 9, line 16, to read as 
follows : 

For option (I) the color segmentor outputs a segmentation map 
S„^, , See Fig. 8. Each sample in S^^i^ represents a spatially 
corresponding PxQ block of frame . The value of the sample "n" is 
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{O, 1,,.., Nj, where {l,..., n^} are the color models provided to the 
color segmentor and {0} represents "garbage". The segmentation map is 
converted to a binary alpha map of^^i by tagging all samples as S^,^ that 
have the same color model aa object #K, Thus pixels in Qf„,j have a 
value 2 55 if their corresponding PxQ block in 1^,^ has the same color aa 
object #K, and have a value of 0 otherwise. The alpha map is fed to a 
"grow connections" algorithm (Fig. 9) along with the block coordinates 
of the predicted position of the centroid of object #K, The output ie 
the desired connected region chat is tagged as the object of interest, 
A simple error recovery scheme begins by detecting all connected 
regions in frame that have the same color as object #K, and then 
selects the biggest one among them. 
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